emotional speech recognition and emotion identification in farsi language

speech emotion can add more information to speech in comparison to available textual information. however, it will also lead to some problems in speech recognition process. in a previous study, we depicted the substantial changes of speech parameters caused by speech emotion. therefore, in order to improve emotional speech recognition rate, in a first step, the effects of emotion on speech parameters should be evaluated and in the next steps, emotional speech recognition accuracy be improved through application of suitable parameters. the changes in speech parameters, i.e. formant frequencies and pitch frequency, due to anger and grief were evaluated for farsi language in our former research. in this research, using those results, we try to improve emotional speech recognition accuracy using baseline models. we show that adding parameters such as formant and pitch frequencies to the speech feature vector can improve recognition accuracy. the amount of improvement depends on parameter type, number of mixture components and the emotional condition. proper identification of emotional condition can also help in improving speech recognition accuracy. to recognize emotional condition of speech, formant and pitch frequencies were used successfully in two different approaches, namley decision tree and gmm.